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by 
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the Degree of Master of Science. 

ABSTRACT 


New results are given on the relationships between closed loop 
eigenstructures , state feedback gain matrices of the linear state feed- 
back problem, and quadratic weights of the linear quadratic regulator. 
Previous results are presented and gaps in current knowledge are pointed 
out. Equations are derived for the angles of general multivariable 
root loci and linear quadratic optimal root loci, including angles of 
departure and approach. The generalized eigenvalue problem is used 
for the first time to compute angles of approach. Equations are also 
derived to find the sensitivity of closed loop eigenvalues and the 
directional derivatives of closed loop eigenvectors (with respect to a 
scalar multiplying the feedback gain matrix or the c[uadratic control 
weight) . 

An equivalence class of quadratic weights that produce the same 
asymptotic eigenstructure is defined, sufficient conditions to be in 
it are given, a canonical element is defined, and an algorithm to find 
it is given. The behavior of the optimal root locus in the nonasymp- 
totic region is shown to be different for quadratic weights with the 
same asymptotic properties. 

An algorithm is presented that can be used to select a feedback 
gain matrix for the linear state feedback problem which produces a 
specified asymptotic eigenstructure. Another algorithm is given to 
compute the asymptotic eigenstructure properties inherent in a given 
set of quadratic weights. This is inherently a structurally unstable 
problem, unless the system is "generic". Finally, it is shown that 
optimal root loci for nongeneric problems can be approximated ‘by gen- 
-eric ones in the nonasymptotic region. 
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CHAPTER I 
I ntroduc t ion 

1.1 Motivation and Siimmary of Results 

The linear state feedback .problem [1] is an important tool used 
for control system design. While any practical design must take many 
factors into consideration, a very common design objective is to 
achieve a specified closed loop eigenstructure. By "eigenstructure” 
we mean both the eigenvalues and the eigenvectors of the closed loop 
system. Hence, an important relationship in design is between the 
state feedback gain matrix and the resulting closed loop eigenstructure. 

A version of the linear state feedback problem that has recently 
emerged as an important design is the linear quadratic regulator [2] . 

It was first studied by theoreticians because of its optimal properties, 
but it is primarily due to several other properties that design engineers 
have begun to use it. The linear quadratic regulator is simple to 
implement provided a full state or at least a reconstructed state is 
available, it has inherent multivariable capability, and the design 
algorithms are- fully computerized. Desirable closed loop properties 
exist such as guaranteed stability, guaranteed gain and phase margins - 
[3] , and reasonable eigenstructures.' Here- we are primarily concerned 
with the relationship .between the quadratic weights and the closed loop 
eigenstructure . 

In Chapter II the linear control - problems of interest are defined; 
and’ then 'the relationships-betw.een the feedback gain matrix, the 
quadratic .weights, and the closed loop eigenstzucture- are discussed in 
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terms of maps between parameter spaces. Previous results are presented 
in a tutorial style, references are given, eind it is noted where the 
new results fit in. Some previous results on transmission zeroes are 
presented, also in tutorial style, in the Appendix. 

The new results are now summarized, first for the linear state 
feedback problem and then for the linear quadratic regulator. In the 
first problem the feedback gain matrix and the closed loop eigenstruc- 
ture are points in parameter spaces, and under certain, conditions the 
map between them is one-to-one. In the foi^ard direction this map is 
an analysis problem and in the reverse direction it is a synthesis 
problem {selecting a feedback gain matrix to achieve a specified closed 
loop eigenstructure) . 

If the state feedback matrix is multiplied by a scalar and this 
scalar is varied, a curve is traced out in each of the two paramenter 
spaces. Also, the closed loop eigenvalues trace out a multivariable 
root locus on the complex s plane. Chapter III derives equations for 
the angles of the root locus, for the sensitivity of the closed loop 
eigenvalues (how much they change with respect to a change in the 
parameter) , and for the directional derivatives of the closed loop 
eigenvectors . 

As the feedback gain matrix becomes very large the closed loop 
eigenstructure ■ approaches certain asymptotic properties. These proper- 
ties can be parameterized and a map defined between the parameters and 
the feedback gain matrix. Using this map to find a feedback gain matrix 
is, a synthesis problem that is solved, in Chapter V. It is one of many 
ways to select a feedback gain matrix, but has not to our knowledge 
appeared in the literature. 

A similar procedure is used for the linear quadratic regulator. 
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The quadratic weights and the closed loop eigenstructure are points 
in parameter spaces but the map between them is not one-to-one. Many 
different quadratic weights produce the same closed loop eigenstruc- 
ture. As an analysis problem this map has received a lot of attention, 
but as a synthesis problem it has not been used extensively (selecting 
quadratic weights to achieve a specified closed loop eigenstructure 
and then computing the feedback gain matrix) . 

If the weights on the control are multiplied by a scalar and this 
scalar is varied, a curve is traced out in the parameter spaces of 
quadratic weights and the closed loop eigenstructures . Also, the closed 
loop eigenvalues trace out a multivariable optimal root locus on the 
complex s plane. In Chapter III the behavior of the closed loop 
eigenstructure is analyzed and equations are derived for angles, sensi- 
tivities, and directional derivatives. The same is done when the 
quadratic weights are dependent in a more general way on a single para- 
meter, and the particular case of analyzing the inverse square method 
of selecting c[uadratic weights is treated. Also, in Chapter V it is 
shown that optimal root loci for so-called "non-generic” problems can 
be approximated with loci of "generic" ones. 

As the control weights become very small the closed loop eigen- 
structure approaches certain asymptotic properties. Some of the eigen- 
values remain finite and others approach infinity. An algorithm is 
presented in Chapter V that determines how many of each there are and 
in what manner they approach their limit. The associated eigenvectors 
are also described. 

. The asymptotic properties can be parameterized and a map defined 
between the parameters and the quadratic weights. Using this map to 
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select quadratic weights in a synthesis problem that was first studied 
by Harvey and Stein [4] and later generalized by Stein [5] • It turns 
out that many different cpiadratic weights -produce the same asymptotic 
properties, and in Chapter IV an equivalence class of these quadratic 
weights is defined. Sufficient conditions are given to be in a parti- 
cular equivalence class, a canonical element is defined, and an 
algorithm is presented which computes the canonical element. Finally, 
the behavior of the optimal root locus for different members of this 
equivalence class is discussed. 

1,2 Notation 

Matrices are indicated by capital letters. Scalars and vectors 

are indicated by small letters. No underlines are used and whether the 

variable is a scalar or vector is clear from the context. Subspaces 

are indicated by script letters, with the exception of the R , the n 

order real vector space. "Im A" and-"ker A" are the image and kernel 

o ^ 

of A. The symbols E and E indicated equivalence classes as defined 
T - H 

in Chapter IV. A is the transpose of A, and x^ is the Hermitian 

~T —1 T T —1 

transpose of the vector x^. A indicates (A ) or equivalently (A ) 

Equations, examples, lemmas^ and theorems are numbered starting 

from one at the beginning of each chapter. When referenced from within 

the same chapter only the number is used, otherwise C4.1) means the 

first occurence in. Chapter IV. 

A permutation matrix P is a zero matrix with a one in each row and _ 
coliamn. PA. rearranges the rows of A and AP rearranges- the coltxmns of A. 

All of the root locus ' diagrams are in the complex S plane. The x‘s 
are -the open loop poles and the 0 ' s are the transmission zeroes . 
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CHAPTER II 
Background 

2-1 Introduction 

The linear control problems studied -in this thesis are defined; 
and then the relationships between the state feedback gains, the 
quadratic weights, and the closed loop eigenstructure are discussed 
in terms of maps between parameter spaces. Emphasis is placed on both 
the general case of the linear state feedback problem and the special 
case of the linear quadratic regulator. 

2.2 Linear Control Problems 
2.2.1 Linear State Feedback 

Consider the following linear, time invariant system with full 
state feedback: 


X = Ax + Bu 



where x e R 


n 


u e R - 


( 1 ) 

( 2 ) 


V7e will always assume that B is full rank. The matrices (A,B) will be 
either controllable, stabilizable, or neither. The closed loop 
system matrix is 

A^l = A - ^ BF. (3) 

As 'k is varied from infinity down to zero the closed- loop eigenvalues 
trace out a root locus. 
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2.2.2 Linear. Output Feedback 

The outputs anH not the full state are used for feedback. Only 
the case of the same nimfaer'of inputs and outputs is considered. The 
equations are 

X = flx + Bu (4) 

y = Cx 

u = ~ Ky (6) 

where y e R . 

we make the same assumptions about (A,B) as for the linear state feed- 
back problem. C will always be full’ rank and (C,A) will be either 
observable, detectable, or neither. The closed loop system- matrix is 

A ... = A - i bKC, (7) 

. cl k 

and k again sweeps out a root locus. 

Important quantities associated with the system S(A,B,C) are the 
transmission- zeroes. Here we use the definition of transmission 
zeroes due to Rosenbrock [6] , which is equivalent to the following def- 
inition when the number of inputs and outputs are equal [7] . The trans- 
mission zeroes are those values of s, not including uncontrollable or 
unobservable modes , which reduce the rank of 

"a-sI B" 

. -c Q_ 

See Appendix A for further discussion. 

2.2.3 Linear Quadratic Regulator 

This is an important class of linear state feedback controllers. 
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The gain matrix F is chosen so that x and u minimize the cost function 


-/ 


(x^Qx + pu'^Ru)dt 


( 8 ) 


where Q = Q ^0 
T 

R = R > 0 
and 0 < p < «> . 


The state weighting matrix can be factored into 

T 

Q = M M 

where Rank{Q) = Rank(M) = p and M is p x m. The matrix is arbitrary 

to within a premultiplicatibn by a' p. x p unitary matrix CW such that 
T 

W W = I) • When Rank (Q) = m then we will use 

T 

Q = 

where H is m x n. Assume that (A,B) is stabilizable and (M>A) is de- 
tectable. The assumptions on Q will sometimes be downgraded to 
symmetric and not necessarily non-negative definite. 

The optimal gain matrix is found by first solving the algebraic 
Riccati equation [2] 

T 1 -1 T (9) 

0=0+ A P + PA - - PER BP 
^ P 

to obtain 

1 —IT 

'F = - R B P (10). 

P 

u = -Fx . 

The closed' loop system matrix is 

■A^^(p) = A - BF. 


( 12 ) 
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The parameter p is included to emphasize the dependence of on it- 
As p varies from infinity down to zero the closed loop eigenvalues 
trace out an optimal root locus. 

2.2.4 Hamiltonian System 

The Hamiltonian system is defined to be 



It is of interest because it describes solutions of the linear quadratic 

regulator problem [8] . The eigenvalues of Z are symmetric about the 

imaginary axis. Therefore if s^ is an eigenvalue so is “S^. Those in 

the left half plane (LHP) are the same as the closed loop eigenvalues 

T T T 

of the linear quadratic regulator. If {x^ ' ^ eigenvector 

r 

of Z associated with a LHP eigenvalue then the portion x^ is an eigen- 
vector of the linear quadratic regulator. Furthermore, = Px^. ' 

The following trick is a useful way of' applying root locus methods 
derived for linear output feedback systems to the' optimal root locus. 

We define a linear output feedback system that has a closed loop system 
matrix equal to the Hamiltonian, system matrix. Let 
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then 

Z = A- iBKC . 

P 

As p is varied from infinity down to zero the eigenvalues of Z in the 
LHP tract out an optimal root locus. This trace is similar to one 
used by Shaked [9] . 

2.3 Maps 

It is convenient to discuss the linear control problems in terms 
of maps between parameter spaces. This helps to organize the presen- 
tation of previous results and to show where the new results fit in. 

For quick reference the maps are listed in Table 2.1. In the following 
sections each map is defined and discussed. 

2.3.1 LSF Map 

This is a map associated with the linear state feedback problem 
as described in section 2-2.1. Here we think of the control problem 
as a map between the space of m x n matrices and the space of closed 
loop eigenvalues and eigenvectors. The notation used is 

LSF : F s . , X . , 

1 1 

Given an F matrix it is always possible to compute and then to 
compute the eigenstructure of ^"or the examples in this thesis 

EISPACK'[10] subroutines were used to do this. We note here that non- 
trivial numerical problems arise when the eigenvalues get too close 
together or too far apart. 
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Table 2.1 
Maps 


Linear State Linear Quadratic 

Feedback Regulator 
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2.3.2 ILSF Map 

This is the inverse of the linear state feedback problem and the 
notation used is 

ILSF: S. ,x. ^ F. 

1 X 

The ILSF map represents a synthesis problem: given a desired eigenstruc- 

ture find F such that the closed loop system has this desired eigen- 
structure. 

System controllability is an important issue in the ILSF map. 

Here we think of controllability as the ability to move eigenvalues 

with state feedback. (For a different type of definition see Willems 

and Hitter [11] ) . One way to test for controllability is to pick an 

F matrix by picking at random each element of F from a dense sxibset of 

the real number line, and then using this F to compute the closed loop 

eigenvalues . Those eigenvalues th at do not move are almost surely 

uncontrollable. If all move then the system is controllable. 

A simplified version of the ILSF map is the modal control problem. 

An F matrix is sought which will result in a desired set of eigenvalues, 

called modes. The eigenvectors are not specified. A good treatment 

of this problem, is given by Wonham' [12] . The main results are given 

in the form of a lemma. The multiple input results are due to Wonham. 

Lemma 1 (A,B) is controllable if and only if there exist F 
. matrices (many in general) which place the eigenvalues in 
arbitrary locations. If the system is not controllable then 
only the controllable modes can be -moved. In the single input ' 
case F is unique. 

Many papers have ' been, written about what to do with the extra 
design freedom available when F is not unique- One significant paper 
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is by Moore [13] . He shows that the extra freedom can be used to 

select eigenvectors. His main result is: 

Lemma 2 For the case of distinct closed loop eigenvalues 
a unique F exists which places the eigenvalues and eigen- 
vectors at specified locations if and only if the system 
is controllable and for each x. there exists a v. such that 


[A-S.I 



So we see that the closed loop eigenvectors must lie in certain m 
dimensional subspaces determined by the s^’s. If some of the modes 
are uncontrollable then they must be included in the specified set of 
eigenvalues, but some freedom still exists in selecting the associated 
eigenvectors . 

Moore's proof is constructive and he gives the following algorithm 
for finding P. Select the desired s^ (distinct) and the desired eigen- 
vectors These eigenvectors may or may not lie in the permissible 

subspace, so compute x^ and by projecting x^^ onto the peimnissible 
subspace (using, for instance, singular value decomposition) . Then 
form the matrices 


X — [x^ r • ' ' 

1 n 


N' = [v-,...,v I 
J. m 


If x^, and y^, are .complex conjugates replace them by Re(x^) , 

Im (x^) , and Re(v^) , Im(v^). The gain matrix is then given by 

F = 

In the single input case no. extra freedom ■ exists to select the-x^'s 
because they are each constrained to, a one dimensional subspace. 
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2.3.3 LSF(k) Map 


When k is varied from infinity down to zero a family of linear 
state feedback problems is produced, which will be denoted by 
LSF (k) ; i F ->• s . (k) , X . (k) for 0 < k < » . 

iC 1 j 1 

As k approaches zero the closed loop eigenstructure approaches certain 
asymptotic properties. As k varies over its range the s^'s trace out 
a root locus, which in the single input case is the classical root 
locus. The multiple input case is more involved and is still an area 
of current research. As k varies over its range the x^’s rotate in 
(if x^ and are complex conjugates then use instead Re(x^) and 

Im (x^) ) . Historically very little attention has been given to the 
behavior of the x . ' s . 

X 

In Chapter III some new results are derived about the behavior of 
the closed loop eigenstructure as a function of k. Angles on the root 
locus are defined, and by using the generalized eigenvalue problem 
equations are derived to compute the angles. See Appendix A for a 
brief explanation of the generalized eigenvalue problem. The advantage 
of using it is that angles can be computed when k=0, even though 1/k 
is not defined. Also in Chapter III, equations are derived to compute 
directional derivatives of the x . ' s . 

X 

2.3-4 Root Locus 

In the single input case the root locus methods of classical con- 
trol can be used to describe the behavior of the closed loop eigenvalues. 
These methods were first developed by Evans in 1948 [14] . They are 
described in Eveleigh [15] , Melsa and Schwartz [16] , and most other 
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classical control textbooks. Descriptions of computer aided plotting 
routines have appeared in literature as recently as 1978 [17] . i 

For the purpose of analyzing the root locus it is always possible 
to rephrase the state feedback problem (1-3) as an output feedback 
problem (4-7) . Simply let KC = F. 

The starting point for the classical root locus is the output 
feedback problem with a single input and output. The time domain des- 
cription (4-6) is Laplace' Transformed in order to get the following 
transfer function, which is the ratio of two polynomials: 


y(s) 

u(s) 


= c(sl - A) 



a 


N(s) 

D(s) 


P 

where N{s) = II (s-z.) 

i=l "• 

n 

and D(s) = E (s-p.). 

i=l ^ 


The z^'s are transmission zeroes and the p^'s are open loop poles. The 
feedback loop is closed by letting 

u(s) = - ^ y(s) + u(s) , 

where u(s) is an external input. The closed loop transfer function is 


y (s) 
u(s) 


a N(s) 


D'(s) + ^ N (a) 

iC 


(15) 


The closed loop eigenvalues are those values of s which make the denomin- 
ator equal to zero, and may be plotted as a function of k. 

Generalizing the classical root locus methods to the multiple 
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input case has proven to be a difficult task. Kouraritakas , Shaked, 
and Postlethwaite [18-22] have addressed various aspects of the problem. 
Progress was slow at first due to a debate over the definition of multi- 
variable transmission zeroes. That debate is beginning to subside and 
attention is shifting to the behavior of modes that asymptotically 
approach infinity. 

As is often the case in control theory, root locus problems can 
be attacked 'with' either time or frequency domain techniques. In the' 
frequency domain, the closed loop transfer function must be replaced - 
by a transfer function matrix. Then the closed loop poles are no 
longer characterized by the denominator in (15) but by an algebraic 
function (a polynomial in s with coefficients that are polynomials in 
k)'. In order to discuss solutions of this algebraic equation concepts 
such as Riemann surfaces must be introduced. Asymptotic results can 
be found by using a Newton chart. These complications are sidestepped 
here by staying in the time domain whenever possible. 

Of particular interest is the case when Rank(CB) = m. Why this 
case' is of interest, is motivated by Wonham [12] , and also [18-22] . 

This is called the generic case,, and it is the only one that will be 
reviewed in depth. The word "generic" will be used to describe a pro- 
perty which holds everywhere on a set of points except those belonging 
to a mathematical variety. A "variety" is a locus of points which satisfy 
-a finite number of polynomials [12]' . In this case the property is that 
Rank(CB) = m. The only points for which this property does not hold 
is' when the polynomial det(CB) =0. In the following example Rank(CB).<m; 


■ro 

0 


“l 

o" 

ro. 

o' 

CB = L'O 

1 

oj- 

0 

1 

- [o 

1 _ 




.0 

0 _ 
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This is the nongeneric case. However, if the 1,1 element of C is per- 
turbed an arbitrarily small amount e then Rank(CB) = m, which is the 
generic case. 

The following facts are known about the multivariable root locus 
for the generic case. We assume that (A,B) is controllable and that 
KCB has no Jordan blocks of size greater than 1x1. Then 

1) The root locus has n branches, and these are symmetric about 
the real axis. 

2) For large k the branches originate at the open loop poles. 

3) For m=l and a>0 (<0) , where a is defined in (15) , the real 
axis to the left (right) of an odd number of singularities lies 
on the locus. This rule does not apply when m>l. 

4) As k 0, (n-m) of the branches stay finite. These are 
characterized by 


S = diag (s^ 


rS'" ) 

n-m 


X 


0 



1 

/X ] 

n-m 


9 


where each pair t x^'is a solution of the generalized eigen- 
value problem 


= 0 . 


The (n-m> finite branches approach the transmission zeroes s , 
and the eigenvectors approach the zero directions x^° . 

5) As k -> 0, m branches tend to infinity. These are characterized 
by 


, 0^ 


O' 

A— S « I B 


X . 

1 


1 

-C 0 


0 

V. 



1 


CO CO 

S = diag(s^ , 


CO 

S 

n 


) 


Co co' CO 

w = [v^ , . . , , ] , 

1 m 


CO CO 

where each pair s^ , x^ is a solution of the eigenvalue problem 


(s^ I - KCB)v^ = 


0 . 
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The m branches approach infinity along asymptotes that have angles 
with respect to the positive real axis given by arg ) , where 
‘’arg(x)” means the argument of the complex number x. The asymptotic 
radius is js. j/k. The associated eigenvectors approach If 

the s . “ are not distinct then the eigenvectors are arbitrary to 
within a subspace. 

Some results are available for the root locus in the nongeneric 
case [18,22] . The final answers are not in yet and the state of the 
art is best described as messy. As k 0, fewer than (n-m) modes re- 
main finite, and these are characterized by the same generalized eigen- 
value problem. The rest of the modes group into m patterns that 
approach infinity. The asymptotes of each pattern meet a pivot point. 


2.3.5 Definition of Angles 


There are n values of s. on the root locus for each value of k. 

1 

If k is perturbed an amount Ak then each s^ will be perturbed by a 
(possibly very large) amount As^. As Ak -s- 0 then As^/Ak will approach 
the constant ds^/dk, and the angle on the root locus is defined to be 

arg (ds^) . 

The angles at the open loop poles (k <») will be called "angles of 
departure", and the angles at the transmission zeroes (k 0) will be 
called "angles of arrival". An example of angles on the root locus 
is shown in Figure 2.1. 

For the single input case standard root locus formulas are available 
to find the angles of departure and approach. Postlethwaite [21] extends 
these results to the multiple input case using frequency domain methods. 
Shaked [19] does so using time domain methods. Here we use new time 
domain methods (the generalized eigenvalue problem) to extend Shaked 's 


‘ results. 
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Figure 2.1 
Definition of Angles 
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2.3.6 I&LSF Map 

This is called the inverse asymptotic linear state feedback map. 

It is the inverse of the LSP(k) map as k -j- 0 and is denoted by 

lALSF: lim s. (k) , liiti x. (k) ^ F. 

k-^0 ^ k-^0 ^ 

The IMiSP map represents a synthesis problem: given the desired 

asymptotic properties of the LSF{k) map characterized by 

o 0 “ “ 

S , X , S , and N ; 

find F such that the closed loop system has these desired asymptotic 
properties. This problem is solved for the first time in Chapter V. 

It is similar to synthesis problems solved by Moore [13 ] , Harvey and 
Stein [4] , and stein [5] . 

2.3.7 LQR Map 

This map is associated with the - linear quadratic regulator as 
described in section 2.2.3. Here we think of the regulator as a map 
between the matrices Q and R and the closed loop eigenstructure . The 
notation used is 

LQR: 0/R s^,x^. 

The LQR map is one of the cornerstones of modern. control theory. Major 
credit is due to Kalman [23] . 

The steps used to compute the closed loop eigenstructure are 
symbolically shown by 

Q,R-S“P->-F^A.,^s.,x.. 

The most important step is first finding the Riccati solution. Wonham 
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[24l gives the necessary and sufficient conditions on A/ B/ Q, R for 
the existence of a stable closed loop solution. 

An active area of research is developing algorithms to compute 
Riccati solutions. One standard way is to use the eigenvectors of the 
Hamiltonian system matrix [8] . This method is usually referred to in 
the control literature as Potter's method but it predates him, {see 
the references of [25] ) . The method is symbolically shown by 

Q,R Z -5- P. 

A variation of this method with improved numerical properties is by 

Laub [25] and uses the Schur vectors of Z. 

1 

For the example calculations used here we were not interested in 
P or P, so the following shortcut was used to find the closed loop 
eigen structure : 

Q,R ^ Z -> s . ,x. . 

A simple example shows that the Q and R matrices that produce an 
optimal gain matrix (and hence a closed loop eigenstructure) are not 
unique. Multiply Q and R by the same positive constant a. Then the 
Riccati solution changes from P to aP but F stays the same. Therefore 
we can define a mathematical equivalence class [26] of Q and R matrices 
in terms of the property that they produce the same optimal gain matrix 

Perhaps not so well known is that any Q with Q ^ 0 and Rank(Q) > m 
is equivalent (in the sense used above) to a Q with Rank(Q) = m. This 
result is used and discussed by Molinari [27] and Harvey and Stein [4] , 
and is due to Popov [28] . As a consequence it is always possible to 
define a response vector 

r = Hx 
where r e 
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T 

Q = H H, 

and such that Q is equivalent to any specified Q. The system S(A,B,H) 
is important to this thesis. 

Necessary and sufficient conditions for (Q,R) and (Q,R) to be in 

the same equivalence class have been developed by Molinari [27] and 

Jameson and Kriendler [29] . Molinari constrains R so that R=I and 

T 

presents - the following result (which is also valid for any R = R >0) 

Lenrnia 3 Assiime (A,B) is controllable and F is optimal for some 
(Q,R) . Then (Q,R) is in the same equivalence class if and only 
if there exists a real symmetric Y satisfying 

(i) Q = A - a\ - YA 

(ii) YB = 0. 

. -1 T 

The Rxccati solution changes from P to P+Y, but F = -R B (P+Y) remains 

T 

constant becuase B Y = 0. There is no guarantee that P+Y ^0 or Q ^ 0. 
When R is not constrained to be constant then a similar result can be 
extracted (with some difficulty) from the paper by Jameson and Kriendler 

2.3.8 ILQR Map 

This map describes the inverse of the linear quadratic regulator 
and is denoted by 

ILOR: s.,x. *> Q/R- 

The ILQR map represents a synthesis problem and can, in principle, be 
used to select quadratic weights. This turns out not to be very prac- 
tical, as we will show in the following discussion. The asymptotic 
version of this map, presented later, is much more convenient. 

The first step is to find the feedback gain matrix which produces 
the desired eigenstructure. To do this use the ILSF map discussed in 
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section 2.3.2 (specifically the algorithm due to Moore [13]). If (A,B) 
is, controllable then the can be located anywhere, and the must 
lie in certain m dimensional subspaces. 

If the feedback gain matrix exists then a check can be made that 
it is optimal for some (Q,R) . Kalman [30] solved this problem for 
the single input case. Anderson and Moore [13] generalized this result 
to the multiple input case. The version of this result presented here 
is due to Molinari [27] . • 

Lemma 4 Asstmie (A,B) is controllable and R=I. Then F is optimal 
for some Q = Q ^ 0 if and only if s. <0 and t (jw)T( jco) ^ I, 
where T(s) = I + F(Is-A)“l B. ^ 

Unfortunately this result is difficult to implement because it must be 

true for all m. If Q is only required to be symmetric then we have the 

following result, also due to Molinari. 

Lemma 5 Assume (A,B) is controllable and R=l. Then P is optimal 
for some Q = if and only if s^ < 0 and ,PB is symmetric. 

Jameson and Kriendler [29] extend this result to a-more general class of 

A, B, and R matrices, again only requiring that Q be symmetric. 

If the check on F succeeds then F is optimal for some (Q,R) . 

Jameson and Kriendler give an algorithm that can reach every (Q,R) in 

the equivalence class of matrices that produce the same F {there is no 

guarantee that Q _> 0) . However, if the check on F fails then no hint 

is given as to how F, s^, or x^ should be changed. This is the main 

problem with using the lALQR map as a way to select quadratic weights. 

We note here that T(s) defined in lemma 4 is the return difference 

equation for the system S(A,B,F), and as such it plays a fundamental 

role in control system design. It is used to measure the disturbance 

rejection properties of the system, the ability of the system .to follow 

commands, and the robustness of the system. 
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2.3.9 LQR(p) Map 

When p is varied from infinity down to zero a family of linear 
quadratic regulators is produced, which will be denoted by 

LQR(p) : Q, pR s^{p), x^Cp) for 0 < p < “. 

Only the case where R is linearly dependent on p is considered. Similar 
results, especially for eigenvectors, do not necessarily hold when Q 
and R are dependent on p in an arbitrary way. The closed loop eigen- 
values trace out an optimal root locus. Its behavior is studied, as 
described in section 2.2.4, by using the Hamiltonian system. Of special 
interest is the asymptotic behavior of the s^(p) and x^Cp) as p ->-0. 

Several new results are derived that concern the LQR(p) map. In 
Chapter III equations are derived that compute angles on the optimal 
root locus and directional derivatives of the x^(p). In Chapter V an 
algorithm is presented that computes the asymptotically infinite be- 
havior of the optimal root locus, and a result is presented that 
shows how an optimal root locus can be approximated by another. 

2.3.10 Optimal Root Locus 

In the single input case the optimal root locus can be described 

using classical root locus techniques. The trick is to recognize 

that the optimal closed loop poles are the left half plane eigenvalues 

T 

of detCsI-Z) - 0. Assume that Q = h h, where h is 1 x n, and that 
R = r > O'. Then by using deteinninant identities it can be shown that 
[ 8 ] 

det(sI-Z) = C-1) ^ [(!> (s) <{) t-s) + ^ i(;(s)i{;(-s)] 


(16) 
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n 

where (ji(s) = det{sI-A) = II (s-p.) 

i=l ^ 

T -1 ^ 

and ^(s) = (}t(s)h (sI-A) b = all (s-z^) . 

i=l 

The P^'s are the open loop poles and the z^'s are the transmission 
zeroes of the system S(A,b,h). Equation (16) is analogous to the 
denominator of (15) . 

Before the heyday of Kalman, state space techniques, and Riccati 

equations it was recognized by Chang [32] that (16) can be used to 

plot the single input optimal root locus. He suggested using the 

root square locus, which is done by rewriting (16) as a polynomial in 
2 

s' = s , and then plotting the classical root locus on the s' plane. 
Kalman [30] and Kwakernaak and Sivan [8] give rules for plotting the 
single input optimal root locus on the s plane. These rules involve 
plotting (16) on the s plane using classical root locus techniques and 
then only keeping the left half side~^ 

Now we move on to the multiple input case of the optimal root locus. 
Rynaski [33] developed a multivariable version of the root square locus, 
but it is very cumbersome even for the case of two inputs. The proce- 
dure used here is to use the Hamiltonian system S(A,B,KC) and apply 

the multivariable root locus results [34] . The generic case is when MB 

T 

is full rank (where Q = M M) . Both this and the nongeneric case will 
be reviewed. The symmetry about the imaginary axis of the eigenvalues 
of the Hamiltonian system makes the analysis easier. The notation used 
here is the same as used by Stein [5] . 
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1) The optimal root locus has n branches , which stay entirely in the 
LHP, and are symmetric about the real axis'. 

2) For p large the branches originate at -jRe p^| + j Im p.. 

(This is equal to p. if p. is in the LHP, otherwise to the mirror 
image of p^ about tlie imaginary axis) . 

3) For m=l and (n-p) even (odd) the negative real axis to the left 
of an odd (even) number of singularities lies on the locus. This 
rule does not apply when m > 1. 

4) As p 0, p of the branches stay finite. These are characterized 
by 


S° = diag ( s , . . . , s ° ) 

X° = ix° , . . . ] , 

where each pair s ° , x ° is a solution of the generalized eigen- 
value problem 



If H is available then a lower dimensional generalized eigenvalue 
problem can be solved using the system S(A,B,H). If s. and x^ are 
the finite solutions then s.° = -|Re s.| + j Im s., but x ° = x . 
only if the corresponding s. is in the LHP. The p branches that 
stay finite approach the s.^, and the associated eigenvectors 
approach the x.°. In the generic case p = n - iti, in the non- 
generic case 0 ^ p < n - m 

5) In the generic case the asymptotically infinite behavior is 
characterized by 


CO 00 00 

S = diag (s. , . . . ,s ) 
^1 m 


GO 

N = 




where each pair s^ , 


00 


V. 

i 


is a solution of the eigenvalue problem 
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CO 2 —X T 1 

[{S^ ) 1 - R B QB]v^ =- 0. 


The. m branches which approach infinity stay ■ on the negative 
•real axis with an asymptotic radius of s.”/p^ . {These are first 
order Butterworth patterns, contrary to Wonham [12] p. 3i8), The 
.associated eigenvectors approach Bv^“, 

6) In the nongeneric case the infinite behavior is characterized 
by the same s“ and and also by a multi- index y- The (n-p) 
branches that approach- infinity group into m Butterworth patterns. 
The ith pattern is n^th order, with asymptotic radii equal to 



Properties of Butterworth patterns are summarized in Table 2.2, 
There are n. vectors which form a basis for the subspace- associated, 
with each pattern. These are 


„ CO CO n,; — 1 00 

, AB\)^ 1 BV^ , 

The multi- index y lists the n^'s in the following way; 


y= (01, 11, 21, ,[n^-l]l, 02, — , [n^-l] 2, . . . , [n^-l]m) 


If we define the controllability matrix 


u = [bn“, , . . ,abn”, , . . bn"”] , 


which is an n X Chm) matrix, then each term (i,j) of the multi- 
index defines the column A^BV-” of U. The collection of all 
columns defined by y we call tJ , therefore 


U' 


= [BV, 


,A^3. 


m 


Y 

The columns of U form a basis for the subspaces spanned by all m 
Butterworth patterns, in the generic case u"*" == BN°“, 

Computing s'”, n"”, and y in the nongeneric case is numerically 
an ill-posed problem because arbitrarily small changes in B or H 
cause the problem to become generic with only first order patterns. 
The s.“'s and associated with first order patterns are the 

-nonzero solutions of the eigenvalue problem given in step 5. 
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Table 2.2 

B-g-tterworth Patterns 

Order Angles that the asymptotes make with the negative 

real axis 

1 0 ° 

2 ±45° 

3 0°, ±60° 

n (odd) ±.~ 180° £ - 0, 1, 

n 2 

n (even) + ^ {£,+35)180°, £, = 0, 1, . , . , j - 1 
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The results for the multiple input case have been established 
over the last several years. The attraction of the finite branches to 
the transmission zeroes of S(A,B,H) is stated in Kwakernaak and Sivan 
[8] . Both Kouvaritakas [34] and Shaked [19] use the Hamiltonian 
system to find the transmission zeroes. Neither use the generalized 
eigenvalue problem, as done here, which can easily be used to compute 
the transmission zeroes and angles of arrival. Kwakernaak and Sivan 
[8] conjecture that the infinite modes group into Butterworth patterns, 
and Kwakernaak [35] later used some algebraic function theory to prove 
this. Wonham [12] gives a theorem which describes the behavior of the 
optimal root locus' in the generic case. The asymptotic behavior of the 
eigenvectors was established by Harvey and Stein [4] in the generic , 

CQ 

case and by stein [5] in the nongeneric case. Algorithms to find S 
and Y a^re given by Shaked [19] and Postlethwaite [36] , but neither 
addresses the inherent numerical instability of their solutions. An 
algorithm to find S“, N“, and y is given here in Chapter V. 

2.3.11 The lALQR Map 

The last of the maps to be defined is the inverse of the LQR(p) 
map as p 0, and it is denoted by 

lALQR: lim s. (p) , lim x. (p) ->• Q,pR. 

p^ p^O 

This again represents a synthesis problem: given the desired asymptotic 

properties of the LQR(p) map characterized by 

o o <» “> 

S. , X , S , N , and y. 
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find g and R such, that the optimal regulator has these desired properties. 
This synthesis problem is posed and solved by Harvey and Stein [4] in 
the generic case and by Stein [5] in the nongeneric case- 

The algorithm presented by Stein starts with the following assump- 
tions; The S° matrix has p stable diagonal elements. The p colvmms 
of X° are linearly independent and for each there exists a such that 
CA-s^°lx^o + Bv^° = 0. Furthermore, the x^^° do not lie in the image of 
U . CTo avoid complex arithmetic S can be made block diagonal and 
the complex conjugate columns x^ and can be replaced by Re x^ and 

CO 

Im • The S matrix has m nonzero and positive diagonal elements. 

00 

The N matrix in invertible, and the multi-index y is such that 

n, + — + n = n - p. 

1 m 

Let p be a permutation matrix that switches around the columns of 

Y Y 

U in an arbitrary manner except that the last m columns of U'p are 

n. T-l 00 n_,— 1 

A 1 , . . . ,A ™ Bv . Then we have 

Lemma 6 The quadratic weighting matrices (not unique) that produce 
the desired asymptotic properties are given by 

H = [0,1] [X°, u’'^P]”^ 

Q h'^H. 

The last step in the synthesis problem is to solve the linear 
quadratic regulator problem for several values of p and "trade off" 
control energy with eigenvalue and eigenvector placement. 

2.3.12 Selecting Quadratic Weights 

The following quote from Athens [2] in 1971 is still true today. 
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The selection of weighting matrices in the quadratic 
criterion is not a simple matter. Usually they are 
selected by the designer on the basis of engineering 
experience coupled with alternate simulation runs for 
different trial values. There is no universal agree- 
ment on precisely how these are to be selected for any 
given application. 

At the heart of the problem is that many different and sometimes 
contradictoiry specifications have to be lumped into a single cost 
function. Over the years several ad hoc methods have been developed, 
the best known being the inverse square method due to Bryson. A few 
remarks are made in Chapter III about this method. See the references 
in Harvey and Stein [4] for other methods.. None can be considered 
uniquely satisfactory - 

Some encouraging progress has been made on the problem of selecting 
quadratic weights to produce a desired asymptotic eigenstructure . The 
algorithm due to Stein [5] presented in the previous section is an 
example of this. There remain, however, other types of specifications 
which cannot adequately be described using a closed loop eigenstructure. 
For example, constraints may exist on feedback gain levels, or adequate 
stability margins may have to be assured. The relationship between 
quadratic weights and these types of specifications needs further 


research. 
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CHAPTER III 
Angles 

3 . 1 Introduction 

Equations are derived for the angles on the root locus of the out- 
put feedback problem. The angles can be computed at any point' ihciiidihg - 
the points of .departure and approach. By using the generalized eigen- 
value problem the angles of approach can easily be computed. These 
results are then applied to the optimal root locus of the linear 
quadratic regulator by using the Hamiltonian system. Equations are 
also derived to find the sensitivity of the closed loop eigenvalues and 
the directional derivatives of the closed loop eigenvectors. Finally, 
a more general dependence of Q and R on p is considered and equations 
for angles and sensitivities are used to analyze the inverse square 
method of selecting quadratic weights. 

Only the case of distinct closed loop eigenvalues is considered. 

The equations derived in this chapter are not valid at the points 
where there are multiple closed loop eigenvalues, and the equations 
cannot easily be extended to handle these cases. 

3 . 2 The Ouput Feedback Problem 

3.2.1 Finding the Closed Loop Eigen structure Using the Generalized 
Eigenvalue Problem 

The closed loop system matrix for the output feedback problem is 

- 1 

The closed loop eigenvalues, eigenvectors, and left eigenvectors are 
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defined in the usual way by 


» - Sj^Dx. = 0 


y/ »cl - = ° (3) 

Now we state a lentma which we shall use in the remainder of this 
chapter . 

H 

Lemma 1 The s . , x . , and y . are solutions of the generalized 
eigenvalue problems . 



Remark k=0 is now allowed, in which case (4) and (5) can be used 
to find the transmission zeroes,— zero directions, and left zero 
directions. 

Remark When k > 0 there are exactly n finite solutions to (4) 
and (5) , and when k=0 there are anywhere from 0 to n-m finite 
solutions - 

To prove lemma 1, from (4) we see that 


(A-s^l)x^ + = 0 


V. 

1 



X . 


1 


{A-S.I)x. - i B K C X, = 0, 
Ilk 1 


(6) 


and then (2) follows immediately from (6) . Therefore the s^ and 
that are solutions of the generalized eigenvalue problem are the closed 
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loop eigenvalues and eigenvectors- In a similar way (5) can be reduced 
to (3) , and the proof is complete. 

Lemma 1 is not a new result, but it is not well Icnown. Its proof 
is simple and direct, and it provides valuable insight into the feedback 
control problem. For example, Laub used this result to show the 
relationship of two methods of computing transmission zeroes (see 
Appendix A). It turns out that the v^^'s and used to com- 

pute angles of arrival to the transmission zeroes. 


3.2.2 Finding ds./<3k Using the Eigenvalue and Generalized Eigenvalue 
Problems 


In the eigenvalue problems (2) and (3) the first derivative of A^^ 
with respect to k exists everywhere in the open interval (0,<») . We use 
this fact to find ds^/dk, the derivative of the closed loop eigenvalue 
with respect to ,k. 

Lemma 2 For any k in the interval (0,<») , and for any distinct s^. 


ds . 
1 

dk 


y.^ B K C X. 
X 

H 

y. X. 

1 1 


(7) 


To prove lemma 2 differentiate (2) to get 


a j 

-jr- (A ,-S.I) X. + (A -S.I) X. = 0 . 
dk cl X X cl X dk X 


( 8 ) 


Multiply on the left by the left eigenvector y^ , which cancels the 


second term and leaves 



d 

dk 


(A,i-Sil) 


X. = 
X 


0 . 
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Rearrange to get 



Differentiate to get (7) . It is always possible to normalize the 

H 

eigenvectors so that y^ = 1, in which case the denominator in- (7) 

can be removed. This completes the proof. 

Lemma 2 is a standard result that can be extracted from the 

higher mathematics of Kato [37] . Wilkinson [38] gives a more readable 

derivation of a similar result - the sensitivity of s^ to changes in 

A , . Shaked [19] derives and uses (7) . 
cl 

In the generalized eigenvalue, problems (4) and (5) the first 
derivative of -the large matrices with respect to k exist everywhere in 
the semi-open interval [0,<») . We use this fact to again find ds^/dk. 
Lemma 3 For any k in the interval [O,") and for any distinct s^. 







( 9 ) 


To prove lemma 3 use obvious substitution of (4) to get 


Differentiate to get 


[L(k) - s.M]v. = 0. 

X I 


dk 


dv. 

{L - s.M) V. + (L - s.M)-— i- 
XX X dk 


0 . 


H 

Multiply on the left by the left eigenvector, call it u^^^ , which will 
cancel the second term and leave 
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d 

dk 


CL - s^M) 


V. = 0. 
X 


Rearrange to get 



Differentiate L and substitute back the original terms to get (9) * 

This completes the proof. Stewart [3-9] has worked on a problem similar 
to this - the sensitivity of s^ to changes in L and M. 

3.2.3 Angles on the Root Locus 


Theorem 1 The angles on the root locus, for any value of k in the 
interval [0,»] and for any distinct s^, are found -by 


arg Cds^) = arg 



0 < k < 03 


CIO) 



0 < k < ■» . 


( 11 ) 


Remark The angles of departure are found using (10) with k = ■» 

(to be more precise, let 3 . = 1/k and use £ = 0) . The angles of 
approach are found using (11) with k = 0. 

Remark (10) is due to Shaked [19] , '(11) is new. 

We prove theorem 1 by showing (10) and then (11) are correct. To 
derive (10) start with (7) of lemma 2, the formula for the derivative 


of an eigenvalue. We have that 




y.’^ B K C X. 
X X 

H 

y. X. 

X X 


/ 


arg 
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and then the angle is 


arg(ds^) =• arg(dk) + arg(-^J+ arg(-l) 




+ arg 


tl' 

-y. B K C X. 
_i 1 

H 

y. X. 

1 1 


Now arg (-1) = 180° , and because k is positive and varies negatively 

. . 2 
from infxnity to zero it follows that arg(l/k ) - 0° and arg(dk) = 180°. 

Therefore (10) is true. 

We cannot use k=0 in (10) becuase A , is not defined for k=0. It 

cl , 

is very awkward to use a limiting argument as k 0 (as does Shaked 
[19]) because Cx^ 0 and y^ B 0, as seen from (4) and (5). 

To derive (11) start with (9) of lemma 3, the formula for, the 
derivative of a generalized eigenvalue. We note that (9) is well 
defined for k=0. The formula for the angle is 


arg(ds^) = arg(dk) + arg(-l) + argi 


H -1 
^ ^i 
H 

y. X. 

■'i 1 


Since arg(dk) = 180° and arg(-l) = 180°, (11) follows. This completes 
the proof . 

When k'is' in the interval C0,«) either (10) or (11) can be used 
to find angles. To show this we note from (4) and (5) of lemma 1 that 

Cx. = -k K~\. 

X 1 


, H -1 
y^ B = k K . 
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Substitute these into (10) , and the result by inspection is (11) . 

Except for k. very close to or equal to zero/ (10) is better to use for 
computing angles because it involves solving an eigenvalue problem of 
lower dimension than the corresponding generalized eigenvalue problem. 
When k is very close to zero, however, (11) is a more reliable equation. 
The tradeoffs when k is very close to zero are the same as those for 
solving transmission zeroes using (2) , an eigenvalue problem with high 
gain feedback; or (4) , a generalized eigenvalue problem. Laub [40] 
gives a good discussion of these tradeoffs and concludes that the 
generalized eigenvalue problem is better (for computing transmission 
zeroes) . 

3.2.4 Sensitivity of the Closed Loop Eigenvalues 

For each eigenvalue:' on the root locus we can write the approxima- 
tion 

ds . As . 

^ ft* — 
dk ^ Ak ' 


Therefore 

•lAkl . 

The term jds^/dk[ is defined as the sensitivity of s^. One use of the 
sensitivity is that to a first order approximation a change ]Akj will 
move the closed loop .eigenvalue a distance j | in the direction 
arg (ds^) . It is immediate from lemmas 2 and 3 that 


As . 


-v 

*v 


ds . 
r 


dk 
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Lemma 4 For any k in the interval 


ds . 
1 

1 

_ 

y.^ B K C X. 
■^1 a. 

dk 


H 


k'^ 

y. X. 
1 -1 


ds, 

X 


H „-l 
”1 ^ '’i 

dk 


H 



y . X. 

■^X X 


[0,oo] and for any distinct 


0 < k < » C12} 


0 < k < 00 . C131 


Wilkinson [38] discusses, in detail the sensitivity of eigenvalues 
and eigenvectors, including the case of multiple eigenvalues. It 
turns out to be much easier to derive bounds on |ds^/dk| for the multi- 
ple eigenvalue case than to derive an expression for ds^/dk. For our 
purposes we will continue to assume that the eigenvalues are distinct. 


Example 


Several root loci are plotted for an output feedback problem, and 
the angles are computed in order to verify the preceding results. The 
same system S(A,B,KC) is used 'as .by Shaked Il9j , 


’-4 7 -1 13 


0 

1 

0 3 0 2 

B = 

1 

0 

4 7-4 8 


2 

0 

0-1 0 0 


-2 

0 


C = 


0 -5 
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2 

0 


-2 

2 




Three different output feedback matrices are used, Shaked used K = I. 


Case # 1 Case # 2 Case # 3 


— 1 
H 

0 

o' 



'1 

0 “ 

0 

1 

H 

II 

K = 

0 

50 


K = 



45 


86945AW004 



Figure 3.1 


Root Loci of a Linear System with Output Feedback 
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Table 3.1 

Angles of Departure and Approach for Example 3.1 


Case Ingles of Departure Angles of Approach 
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1 

1 

2 

14 

1 

± 173® 

0° 

180® 

4 170® 

2 

± 149 

O' 

180 

4 121 

3 

+ 135 

0 

180 

4, 114 
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Table 3.2 

Points and Angles on the Root Loci of Example 3.1 


angles are in parentheses 


Case 

k 

Left half plane 

Right half plane 

1 

100 

- 4.45±2.02i 

(+ 177° ) 

1.14 (0°) 

1.94 (180°) 


10 

-11.4 (180) 

-5.16 (0) 

1.6510. 42i 

(± 81) 


1 

-84.1 (180) 

-6.69 (180) 

1.53±0.85i 

(± 137) 


10-" 

-8x10^ (180) 

-3x10® (180) 

l.OOll.OOi 

{+ 170) 

2 

100 

- 4.10±2.06i 

(± 151) 

1.151(0) 

1.93 (180) 


10 

- 4.86±2.40i 

(± 161) 

1.81i0.65i 

(± 57) 


1 

-10.34±0.71i 

(+ 113) 

2.34ll.33i 

(1 85) 


-6 

6 

6 


_ .. 


10 

-8x10 (180) 

-3x10 (180) 

l.OOll.OOi 

(+ 121) 

3 

100 

- 5.85±3.18i 

(± 161) 

2.5711.16i 

(± 15) 


10 

-20.5 (180) 

-8.7 (0) 

4.2010.48i 

(+ 62) 


5 

-37 (180) 

-8.6 (180) 

4.01 Cp) 

5.00 (0) 


1 

-159 (180) 

-12.0 (180) 

3.8411.75 

(± 140) 


-6 

8 

6 


- 


10 

-1.5x10 (180) 

-8x10 (180) 

l.OOll.OOi 

(+ 114) 
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Nxjmerical results are criven in Tables 3.1 and 3.2, and the root loci 
are plotted in Figure 3.1. 

As expected in all three cases the branches of the locus depart 
from the open loop poles. Two of the branches stay entirely in the LHP 
with different angles of departure in all three cases. The branches 
meet on the negative real axis and then continue in opposite directions 
as might be expected in the single input case. However, the branch 
that goes to the right eventually turns around, and then both branches 
approach infinity on the negative 'real axis with different asymptotic 
radii in each case. The other two branches stay entirely in the RHP, 
so the system is always unstable. These branches eventually arrive at 
the transmission zeroes at 1 ± i with different angles of arrival in 
each case. The path taken in the third case is unusual, :to‘ say the 
least. 

Shaked*s paper from which this example is taken contains some 
errors which will be pointed' out here. His calculation for 'the angles 
of departure contains mmerical errors. More importantly, his formula 
for the angles of arrival (3.16b) is incorrect due to an error in 
the derivation after (3.15) . This leads to the incorrect conclusion 
that angles of arrival are independent of the output feedback matrix K. 


3 . 3 The Linear Quadratic Regulator 


Theorem 2 The angles on the optimal root locus, for any value of p 
in the interval [0,<»] , and for any distinct s^, are found by 


arg (ds^) 


= arg 


( — ^ W-H 

-1 t" 

0 BR B 

4 

Vi « 

0 0 

M 

V 

L 



0 < p 


(14) 
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0 p < “ (15) 

Remark The angles of departure are found using (14) with p = 
and the angles of arrival by using (15) with p = 0. 

Theorem 2 is proved by applying ,(10) and (11) of theorem 1 to the 

Hamiltonian system S(A,B,KC). The vectors and w^ are the right and 

left eigenvectors of Z, the Hamiltonian system matrix; and the vectors 
H 

and are found by solving generalized eigenvalue problems analogous 
to (4) and (5) . Note that 

IgT ^ 

0 

This completes the proof. An example of an optimal root locus is 
given in Chapter IV after a discussion of asymptotic equivalence classes. 

The sensitivity of the optimal closed loop eigenvalues is found 
by applying (12) and (13) of lemma 4 to the Hamiltonian system. 

The ntomber of computations needed to compute (14) and CIS) can 
be reduced by using the following identities. First, using (4) and (5) 
it can be shown that 



arg (ds^) = arg 



H H H 

Now let z^ = (x^ ' ^i ^ eigenvector associated with s^ in the 

g g 

LHP , let s . be the mirror of s . in the RHP , and let s . = (x . , ^ . ) 
be the associated eigenvector. Then 



r T H - H, 
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3.4 Directional Derivatives of the Closed Loop Eigenvectors 


We found ds^/dk for the eigenvalue problem in section 3.2.2. 

Now we continue that discussion and find dx^/dk. The references are 
again Kato [37] and Wilkinson [38] . The results are 

Lemma 5 For any value of k in the interval CO,®) / and for any 

. .distinct s . - 
1 


ds. 
1 

dk 

dx. 
1 

dk 



V. 

X 


+ b.x. 

2. X 


where 8 . . 

31 



(16) 

C17) 


V. 

X 


b. 

X 


n 

2 

j=l 

35^1 



s . -s 

. X 


j 


X . 

3 



(18) 


Equation (16) is derived in section 3.2.2 and is included here for 
convenience. To derive (17) we will need the following: 



(19) 


This can be explained as follows; x^(k) and x^(k+Ak) can be normalized 

to lie on the same hypersphere , as Ak ^ 0 then [x^ (k-f Ak) - x^^^ (k) ] /Ak 

dx^/dk, which is tangent to the hyper sphere, and therefore is orthoganol 

to X. . 

X 

Now, since the eigenvectors x^ form a basis for we can write 
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X. 

1 


Xc 


( 20 ) 


dx, 
X 

dk 


Xb, 


(21) 


where b and c are vectors and b^ and Cj|^ are components of these . 
vectors. Substitute (20) and (21) into (8) to get 


(A^^-- s^DXb = Xc. . (22) 

H H 

Multiply C20) on the left by y^ ^ note that yj = 0 for i j , 
and then after some algebra 


^ I 0 


By manipulating (22) we see that (Sj-s^)b^ = c^ for j=l,...,n. Solve 


for b . to get 
1 


b. = 
1 


liii 

s ,-s. 
3 1 


j 7^ i 


(23) 


undetermined j = i 


Substitute (23) into (21) to get (17) . The only thing not determined 

H 

is b^, which we can find by multiplying (17) on the left by x^ to get 


H 

X. 

1 


dx . 
1 

dk 


X. V. + b.x. X. 
1 1 1X1 


By (19) the left hand side is zero, and therefore (18) follows. This 
completes the proof of lemma 5. 

The directional derivatives for the optimal eigenvectors can be 
found in a similar way. Use (17) with the Hamiltonian system to get 
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dz. 
1 

dk 


dx. 
1 

dk 



dk 


and then extract dx./dk, 

1 


3.5 Inverse Square Quadratic Weights 


One coinmon ad hoc method for selecting quadratic weights is the 
inverse square method. Here we give a brief explanation of the method 
and show one way to analyze it if the first guess of quadratic weights 
is not satisfactory. 

Start with the quadratic cost function 



Co 


(x*^Qx + u'^Ru)dt. 


Require that Q and R be diagonal, .and then the cost fiinction can be 


rewritten 



m 

+ E 
i=l 



Decide on a maximum allowable deviation for each state and control and 

call these x. and u. . Then select the weights so that each 
imax imax ^ 

teinn has equal contribution to the cost f\inction at maximum deviation, 

i.e. 


%i 


1 

2 

X. ■ 

imax 


r. . 

11 


1 

2 

u. 

imax 


With Q and R chosen in this manner, compute the optimal gain matrix. 
If the system behaves well with this controller then do not make any 
changes in Q and R. 
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If the system does not behave well with this controller then Q 

and R must be changed. Suppose the state x^(t) is sluggish and needs 

to be speeded up. It may suffice to increase or to decrease the 

weighting on the control that predominantly controls x^. This scheme, 

however, may not work. Suppose the predominant mode of x^ is s^,- in 

other words x. (t) ^ c e where c is a constant. If s. is near a 

1 1 

transmission zero then decreasing the control weight will cause s^ to 
move closer to the transmission zero, and this may even "slow down" s^. 

Now we give.a method to detennine how the modes change with respect 
to a change in one or more of the diagonal elements of Q or R. Simply 
use the following lemma which follows easily from the previous results 
of this chapter. 

Lemma 6 Let Q(p) and R(p) be dependent on p, and let 


-1 T 

A- -BR(p) B 

'Q(p) -A^ 


Then for any p such that dZ/dp is well defined, 

tinct s . , 

1 


arg(dSj^) = arg(dp) + arg 



w. 

X 


z . 

X 


and for any dis~ 
(24) 


ds . 

X 

dp 


H ^ 
i dp 


H 

w. 

X 


z . 

X 


Suppose R is. constant and 


( 25 ) 


Q = diag(q^^, . . . • 
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Tlien dZ/dp will have all zeroes except for Each of the modes 

will move an approximate distance 



Ap 


in the direction arg (ds , ) . ' 
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CHAPTER IV 

Equivalence Classes of Quadratic Weighiis 

4.1 Introduction 

As noted in Chapter II, quadratic weighting matrices are not unique. 
Rather, many choices produce the same controller gains. This chapter 
provides a characterization of two classes of equivalent weights, and 
for one of them defines a unique canonical element. These characteri- 
zations may prove useful in design. 

Both E° and E equivalence classes are defined. Then sufficient 
conditions are given for different quadratic weights to be in the same 
E°° equivalence class (in other words to have the same asymptotic pro- 
perties) . A canonical element of the E class is defined, and an 
algorithm is given to find it. Finally, it is shown by example that 
the closed loop eigenstructure (and hence the optimal root locus) in 

CO 

the nonasymptotic region can be different for members of the same E 
equivalence class. 

* 0 ^ 

4.2 Definitions of the E and £ Equivalence Classes 

(Q,R) and (Q,R) are members of an equivalence class if they 
produce the same optimal gain matrix. We use the following notation: 

(Q,R) E° (Q,R) , 

where E° has the meaning "produces the same optimal gain matrix as." 

This is not the only type of equivalence class that can be defined. 
(Q,pR) and (Q,pR) are members of an equivalence class if they produce 

Q 0 CO <A 

the same asymptotic properties (which are S , X , S , N , and y) , We 
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use the following notations 

(Q,pR) e" (Q,pR), 

CO 

where E has the meaning "produces the same asymptotic properties as." 
The p is • included in the parenthesis to emphasize the dependence on the 
control weight. 

CO 

4.3 Sufficient Conditions to be in the E Equivalence Class 

In the form of two lemmas we present sufficient conditions for 

~ CO 

(Q,pR) and (Q,pR) to be in the same E equivalence class. 

Lemma 1 Assume (A,B) is controllable and F is optimal for some 
(Q,R) . Then 

(Q,pR) e“ (Q,pR) 

if there exists an n x n real symmetric Y such that 

(i) Q = Q - a\ - YA 
(ii) YB = 0. 

To prove this we first show that for any p > 0 the closed loop 
eigenvalues of the optimal regulator ai.-e the same when either Q or Q 
is used (the R is the same in both cases) . The closed loop eigen- 
values are the eigenvalues of Z, the Hamiltonian matrix, and the 
eigenvalues are invariant under the following similarity transformation: 



Using the' same transformation the eigenvectors of Z change from 
T T T T T T 

z^ = (x^ , Xj^ P) to z^ = (x^ , x^ (P4-Y) ) . The x^ portions are the 
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closed .loop eigenvectors of the optimal regulator and these do not change. 
Since for any p > 0 the closed loop eigenstructure is invariant, the 
asymptotic properties as p -> 0 are invariant. This completes the proof. 

To show that the closed loop eigenstructure is the same for any 
p > 0 we could alternatively have used a result due to Molinari [27] 
that was reviewed in section 2.3.8. We note that it is not necessarily 
true that Q ^ 0 or p+Y ^ 0. The conditions given here are only suffi- 
cient. We were not able to prove (and not able to find a counterexample) 
for the converse. 

For the next lemma let D and E be diagonal matrices with positive 
diagonal elements d^ and e^^ such that 

00 

DE = S . 


All of the other terms are defined in sections 2.3.10 and 2.3.11. 

Lemma 2 Assume that (A,B) is controllable; that F is optimal for 
some CQ,R) ; that the asymptotic properties are S,X,S,N, 
and Y? that 


00^ oa 

V. V. =1 for i = l,...,m 

IX 


Then 


(Q,pR) e” (Q,pR) 

if there exists a D and Y such that 


o 

U— 1 

It 

D] [X°, 

(1) 

~ CO 

-T -2 . “ -1 

(2) 

R = (N ) 

E (N ) 

T 

Q = H H 

T 

- AY - YA 

(3) 


Before proving this we note that equations (1-3) are similar to 
those used by Stein [5] in his algorithm for selecting quadratic weights, 

CO 

as reviewed in section 2.3.11. He sets D=I, E=S , and Y=0; and he 
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00 

places no restxiction on the magnitudes of the 's. 

The proof of lemma 2'is in two parts. The first part is to show , 
that subtracting A Y + YA in (3) does not change the asymptotic proper- 
ties, but this was established in lennma 1. The second part is to show 
00 

that S can be split into D and E without changing the asymptotic 

properties. The proof that Stein uses to prove his algorithm is only 

trivially changed when s is split into D and E, so we will not repeat 

it here. ' This completes the proof. 

Only sufficient conditions are given in lemma 2 for quadratic 

00 

weighting matrices to be in the same E ec[uivalence class. We do not 
yet know if these conditions are necessary, in other words if by chang- 

. CO 

ing D and Y every member of the E equivalence class can be reached. 

, TO 

The assumptions about the magnitudes of the 's are made without 
loss of generality. These vectors are used to specify directions, and 
their magnitudes do not change the asymptotic properties. If the *s 
are not of unit magnitude then it is always possible to find a diagonal 
matrix G such that the columns of N = N G are of unit magnitude. 

Then in CD and (2) we can replace n“ by E by EG~^, and D by DG 
without changing H and R. 

Several other changes can be made in (1—3) without affecting R and 

Q. The H in CD can be premultiplied by an m x m unitary matrix (W 
T 

such that WW = I) . Then in (3) when Q is formed the influence of W 
is lost. In Cl) the magnitudes and the order of the columns of and 
all but the last m colvimns of U^p can be changed without changing H. 

In (D the order of the last m columns of U^P/ and in (2) the order of 
the ’s can be changed without changing either H or R, as long as the 

corresponding and e^'s are changed. 
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4.4 A Canonical Element of the e” Equivalence Class 

We defxne the canonical element of the E equivalence class to be 
the (Q,pR) reached by (1-3) when D=I, E=s”, and Y=0. By "canonical" 
we mean unique, but by changing D and Y many other canonical elements 
could be defined. The choice used here has an uncomplicated struc- 
ture and agrees with Stein's algorithm j[5] when the v^'^'s are unit 
magnitude . 

Given any (Q,pR) it is always possible to find the canonical 
element. Use a generalized eigenvalue problem to find S° and X°, as 
.described in section 2.3.10. Use the algorithm in section 5.2 to find 
S , N , and y. Then use (1-3) with D=l, E=s”, and Y=0 (and with 

0O*p 00 

= 1) to find the canonical element (Q,pR) . 

4.5 Behavior of the Optimal Root Locus in the Nonasymptotic Region 

00 

Members of the E equivalence class have the same asymptotic pro- 
perties. They may or may not, however, have the same closed loop eigen- 
structure for p > 0. As a consequence the optimal root loci may look 
very different in the nonasymptotic region. This is important because 
when selecting a Q and R using (1-3) the final choice of pR uses a p>0. 

Suppose a (Q,pR) is computed using equations (1-3). If D and E 

are kept the same and Y is changed to get a different Q then the closed 

loop eigenstructure will be the same for any p>0. This we know is true 

by the proof of lemma 1 (and also due to Molinari [27j ) . For any 

scalar a > 0 if D is changed to aD and E to (l/a)E then (Q,pR) will 

2 2 

change to (a Q,pa R) , and it is easy to see that the closed loop eigen- 
structure is the same for any p >0. However, if D and E are changed 

.in a more complicated way (change d^ to ct^d^ and e^ to (l/a^)e^, where 
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the are ail positive and not all equal) then the closed loop eigen- 

structure will not be the same for any p > 0. Example 4.1 shows how 
the optimal root locus can change in the nonasymptotic region. 

Example 4,1 

We consider a linear system with the following A and B matrices. . 



The asymptotic properties of an optimal linear quadratic regulator are 
specified, and equations (1-3) are used to compute the quadratic weighting 
matrices. Six different values of D and E are chosen. The purpose of 
this example is to show that the choice of D and E does not change the 
asymptotic properties but dramatically changes the behavior of the op- 
timal root loci in the finite region. 

The linear system has four states and two inputs. The first input 
drives a first order subsystem with a pole at -1.0. The second input 
drives a third order subsystem which can be broken down into a damped 
oscillator with poles at -2 ±i and a first order "actuator" with a pole 
at -5. The 0.1 terms in the A matrix couple the two subsystems. 

The asymptotically finite properties are specified by 
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The ”d" means that the eigenvectors are desired and not necessarily 
obtainable. The "V" means that the element is not specified. The 
result of projecting the complex eigenvectors onto the obtainable sub- 
spaces is 


• 


“ 

.341 


-.244 

.561 

± 

1.146 

0 


0 

.232 


4.476 

• 


• 



The asymptotically infinite properties are specified by 


00 


s 



N 


I, Y= (01 r 02). 


In each of the six cases there are two first order Butterworth patterns. 

The D, E, R, and H matrices are shown in Table 3.1. The optimal 
root loci are in Figure 3.1. We see that the behavior of the loci in 
the finite region is dependent on the choice of D and E. The angles 
of departure and approach are different in each of the six cases and 
are listed in Table 3.2. Points on the loci for different values of p 
are listed in Table 3.3. 

In the first case the 2,2 element of R is bigger than the 1,1 
element by a factor of 3200, and for p "not too small" this causes the 
subsystems to decouple. Since the second input is heavily weighted 
the pole at -1 does not move much. On the other hand the branches of 
the locus associated with the third order subsystem (driven by the 
first input) start to behave like the optimal root locus of a single 
input system. Two of the branches form a second order Butterworth 
pattern and the third branch approaches a transmission zero somewhere 
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to the left of -5. Finally, as p gets "very small" the subsystems 
couple together and the specified asymptotic properties are achieved. 
The branches that start at -2 ± i eventually meet on the real axis and 
form two first order Butterworth patterns. 

In the second case the decoupling of the two subsystems is less 
apparent. The branches of the locus that start at -2 ± i meet on the 
negative real axis at about -4.8. One of the branches goes to the left 
and forms a first order pattern. The other goes to ’the right, joins 
the branch that starts at -1, and then they approach the transmission 
zeroes . 

In cases 3 through 6 the branches that leave the open loop poles 
at -2 ± i eventually make it to the transmission zeroes at -.5 ± 3i. 
Given just the locations of the open loop poles and the transmission, 
the locus in case 4 is probably the most "desirable" pattern. This 
case allows a meaningful tradeoff between control weight and asymptotic 
properties. It happens to correspond to the canonical member of the 
e” equivalence class, as defined in the previous section. For a wide - 
range of values of D and E the locus does in fact look like the- one 
in case 4. Not until the 2,2 element of R is smaller than the 1,1 
element by a factor of one million does the behavior of the locus in 
the finite region change significantly. The behavior in cases 5 and 6 
cannot easily be explained. The subsystems do not appear to decouple 
as in cases 1 and 2. 

From the above example it is not obvious how to choose the D and 
E' matrices. Since only the ratios of the diagonal elements of the D 
and E matrices are important there are m-1 degrees of freedom available 
to the designer. (In the single input case there are no extra degrees 
of freedom) . It may be true that the extra degrees of freedom can be 
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used up by specifying angles of approach and departure-, but we do not 
know of any algorithms that allow you to do this, nor do we know of a 
check to determine which angles are valid. 
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■e 4.1 

Root Loci 
86945AW005 





Figure 4,1 Continued 
86945AW006 
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Table 4.1 

Matrices Used in Example 4.1 
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Table 4.2 

Angles of Departure and Approach for Example 4.1 


Case Angles of Departure., Angles of Approach 



-2 ± i 

-5 

-1 

-.5 ± 3i 

1 

±. 

100.8* 

180® 

180® 

± 11.7° 

2 


99.3 

180 

180 

± 11.9 

3 

+ 

98.1 

180 

180 

± 12.1 

4 

+ 

70.5 

180 

180 

± 21.5 

5 1 

+ 

4.9 

180 

180 

± 1.4 

6 

T 

10.2 

0 

180 

+ 9.3 
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Table 4.3 

Points on the Optimal Root Loci of Example 4.1 


Case p Closed Loop' Eigenvalues 


1 

10 

-2.20 ± 1.53i 


-5.08 

-1..28 


1 

-3.03 ± 2.66i 


-5,55 

-1.42 


.1 

-5.16 ± 3.32i 


-6.93 

-1.67 


.01 

-18.5 

-13.8 

-2.17 ± 2.01i 



10“ 

-2 x 106 

-10® 

-0.50 ± 3.001 


2 

10 

-2.13 ± 1.41i 


-5.09 

-1.24 


1 

-2.77 ± 2.42i 


-5.60 

-1.42 


.1 

-4.30 ± 2.94i 


-7-68 

-1.79 


.01 

-19.7 

-12.2 

-1.90± 2.28i 



10“!^ 

-2 x 106 

-10® 

-0.50± 3.001 


3 

10 

-2.09 ± 1.34i 


-5,09 

-1.21 


1 

-2.61 ± 2.28i 


—5. 63 

-1.42 


.1 

-3.84 ± 2.76i 


-8.01 

-1.91 


.01 

-1.73 ± 2.42i 


-20.1 

-11.6 


10-16 

-0.50± 3.00i 


-2x10® 

rlO® 

4 

10 

-2.00±1.07i 


-5.09 

-1.04 


1 

-1.82 ± 1.47i 


-5.72 

-1.41 


.1 

-1.33 ± 2.33i 


-8.85 

-3.32 


.01 

-0.74 ± 2.88i 


-21.1 

-1.01 


10” 

-0.50± 3.00i 


-2x10® 

-10® 

5 

10 

-1.73 ± 1.18i 


-5.08 

-1.87 


1 

-1.65 ± 2.061 


-5.69 

-2.77 


.1 

-1.66 ± 2.89i 


-8.84 

-3.88 


.01 

-1-04 ± 2.99i 


-21.1 

-10.1 


10“ 16 

-0.50 ± 3.001 


-2x10® 

-10® 

6 

10 

-1.89 ± 3. Hi 


-4.81 ± 0.89i 



1 

-2.36 ± 4.521 


-5.99 ± 2.891 



-1 

-3 . 05 ± 5 . 9li 


-8.31 ± 1-581 



.01 

-3.72 ± 5.501 


-21.1 

-10.9 


10“ 16- 

-0.50 ±3.001 


-2x10® 

-10® 
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CHAPTER V 
Related Results 

The three sections in this chapter contain new results concerning 
the relationships between linear state feedback, quadratic weights, 
and' the closed loopi'eigenstructure. 

5.1 An Algorithm for Selecting F to Produce Desired Asymptotic Properties 

In this section an algorithm is given to implement the lALSP map. 
Given the asymptotic properties of the linear state feedback problem 
characterized by S°, S , and N ; we find a feedback gain matrix 
(l/k)P that produces these properties as k 0. Only ■the generic case 
is considered, when Rank(CB) = m; and (A,B) is assumed to be controllable. 

The algorithm presented here is analogous to Ha 2 rvey and Stein's 
algori'thm [4] for selecting quadratic weights (-the lALQR map) . The 
lALQR map gives a way to trade off eigenvalue and eigenvector placement 
with control energy, and indirectly this affects the feedback gains. 

The lAlSP map gives a way to directly trade off eigenvalue aind eigen- 
vector placement with feedback gains, and indirectly this affects con- 
trol energy. 

0 O 0® 

S , X , S , and N are assumed to satisfy the following conditions: 
The S° matrix has (n-m) distinct diagonal elements. The columns of X°, 
as is always the case for closed loop eigenvectors, must be linearly 
independent and. for each there must a such that (A - ,s . °I)x . °+Bv . °=0. 

1 1X1 

Furthermore, it is assumed that the x^° are not in the image of B., 

CTo stay in real arithmetic, let be block diagonal and replace com- 
plex conjugates x^° and with Re(x^°) and Im(x^°)). The s” matrix 
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is assumed to have m nonzero diagonal elements and N is assumed to be 
invertible- 

Theorem 1 The unique P matrix which produces the specified 
asymptotic properties is 

P = (1) 

To prove this we first show that F has the desired asymptotically 
finite eigenstructure. It suffices to show that the s^^® and satisfy 
the generalized eigenvalue problem 



This is true because by assumption there exists a such that 
(A - s.°I)x.° + Bv.° = 0, and by the way F is constructed Fx.° =0. 

Ill 1 

Since PB is full rank there are n-m solutions to- this generalized eigen~ 
value problem - namely the n-m specified values of and 

Next we must show- that P has the desired asymptotically infinite 

CO CO 

eigenstructure. It suffices to show that the s^ and satisfy the 
eigenvalue problem 


(si - FB)v.“ = 0 

CO 

-S . 

where s = — ; — — . 

k 


The parameter s is the ith infinite mode as a function of s^ and k. 

00 CO 

The s^ and satisfy the eigenvalue problem because by the way that 
F is constructed 


00 00 00 
FB = N S (N ) 



The last thing to show is that F is unique. We know that FB is 

^ ' CO 00 CO 

uniquely defined by S and N • (If some of the s^ 's are equal then 
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the \j^ ' s are arbitrary within a subspace but FB remains unchanged) . 
From the way that F is constructed we see that no extra freedom exists 

oo 

to choose F. {If P is multiplied by a scalar a- then each s^^ changes 

CO 

to as^ , and the asymptotic properties are not the same,) The proof, 
is complete. 

Example 5.1 The same A and B matrices are used as in. example 4.1, 
namely that 



The asymptotic properties of this system are specified for three cases, 
and for each the F matrix is computed using (1) . The root loci are 
shown in Figure 5.1. 

The asymptotically finite behavior for each case is specified by 



The infinite behavior is different for each case- The specifications 
and the resulting F matrices are shown in Table 5.1. 

In the first case we have that s^ =1 and s^ - 2 . There are two 
infinite modes that stay on the negative real axis. In the second case 

OO i— CO 

S = 1 ± /3 Since arg(-a ,. ) = ± 120°, the two infinite modes 

1 / ^ 1 , 1 ^ 

approach infinity along asymptotes that make angles of ± 120° with the 

positive real axis. In the third case s-., - = ~/3 ± i, and therefore 

1 
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Figure 5.1 

Root Loci of a Linear System with State Feedback 

86945AW007 


Case'll 






1 
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Case 


Table 5.1 

Matrices Used in Example 5.1 


CO CO 00 

N S (N ) 


1 

0 

0 

-4 

0 

-4 


0 

2 

1 

2 

1 

-2v^ 


0 

16 

8 

16 


0 

4 

2 
' 4 


1 

0 

0 

-4 


8 2 0 
-27.7713 -6.928 -4 


0 

2 

1 

2 


- 3 ; 464 


Table 5.2 

Angles of Departure and Approach for Example 5.1 


Case Angles of Departure 


Angles of Approach. 



-2 ± i 

-5 

-1 

-3 ± 2i 

1 

± 98.1° 

180° 

180° 

1 

+ 161..7° 

2 

± 92.8 

180 

180 

+ 34-. 3 

3 

+ 79.1 

0 

180 

± 32.5 
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the two infinite modes approach infinity along asymptotes that make 
O 

angles of ± 30 with the positive real axis. For high enough gain this 
closed loop system goes unstable. The angles of departure and approach 
are different for each case and are listed in Table 5.2. 

5.2 An Algorithm for Finding the Asymptotically Infinite Behavior of 
the Optimal Root Locus 

00 00 

Given the A, B/ Q, and R matrices the objective is to find s , N , 
and Y? which are used to characterize the asymptotically infinite be- 
havior of the optimal root locus. We assume that (A,B) is controllable 

T 

and (M,A) is observable (where Q = M M, Rank(Q) = Rank(M) = p, and M 
is p X n) . 

The algorithm described here is a variation of Shaked's [9] , which 

00 oo 

can be used to find s and y. The changes made to N simplify the 
algorithm, the main reason for that being the use of siibspaces of 

CO 

spanned by the vectors • After some definitions the algorithm is 
presented in the fom of a theorem. The theorem is proved, the 
matrices are discussed, and then an example is given. 

Define the matrices 
= B^QB 
= (AB)^QAB 

= (A^"^B)^QA^"^B, 

and ■ 

T 

G. = J. J. 

1 IX 

J. = MA^ ^B. 

X 

Define the subspaces of r"* 
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U = 5^ 

0 

ti^ = U n Jeer 

1 o 1 

i /2 = “l/1 ker 




Jeer J . , 
1 


with the dimensions such that 


dim fJ . , - dim (I . = p. , 

' x -1 -^1 

Z = m. 

Finally, define the matrices 

U. = matrix whose columns form a basis for U . , 

1 X 

without loss of generality let = I. 

CO 

N. = m X p. matrix whose colimms are the v. 's 

X ; X X 

corresponding to the p^ ith order Butterworth 

CO 

patterns. If p^ = 0 then is missing and 
there are no ith order Butterworth patterns. 

CO 

= P^ X p^ diagonal matrix whose elements are the 

Co , 

Sj 's corresponding to the p^ xth order Butter- 
worth patterns. If p^ = 0 then is missing. 
Using the above definitions we see that 

00 « 00 co_ 

N. = [N^ ] 

CO CO CO 

S = diag(S^ ,. . . ) , 

where Jc < n - m + 1 is the highest order Butterworth 
pattern. 
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In the generic case k = 
Theorem 2 For i = 

T —1 T 

(u/, RU. ,) U. , 

1-1 1-1 1-1 


1 and = 0„ 

l,...,k consider the Jordan canonical forms 


G. 

1 


^i-1 





( 2 ) 


A is a diagonal matrix with real eigenvalues ^ 0, and 



= u. 

1-1 1 



Remark If there are no ith order Butterworth patterns then Wj_ and 
A will be missing. 

The proof is by induction and uses the fact that all s^ and 
(including those describing the asymptotically infinite behavior) must 
satisfy 

[pR + ^^(-s)$(s)]v = 0 (3) 

where ^(s) = M(sl - A) 

= M(i I + — A + .. .)B. 

S p 


Equation (3) is derived by Harvey and Stein [4] . It can also be found 

by plugging A, B, C, and K of the Hamiltonian system (defined in section 

2.2.4) into (3.4) and manipulating the result. An expanded version of 
T 

§ (-s)$(s) is shown below. 

$^(-s)$(s) = - — G- 
= 2 1 


+ 1 T T 


— (-J^ J3 ^^2 ■ “^3 -^l ^ 

s 
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1 m rn m m 

^ T ‘■"'i '’4 * ''2 '"3 - ■"3 ■"2 ■^4 ■^1 > 

T m m T T 

T '-^1 ^5 * ^2 ^4 - S * ■^4 ^2 4 '"5 ■"!> 


-. ■ m 

+ 4- E. (-l)’j.’^j. . 

j-1 ’ 


The first step is to show that the theorem is v&lid for i = 1. 
Assume without loss of generality that first order patterns exist. 
Rewrite C3) as 


^pR + ~ B*^QB + o|™j 


V = 0. 


As p 0 the — term dominates and this becomes 
4.2 


j^Xi - r”^ b^qbJv = 0 


where X = ps^. 


-1 T 

The eigenvalues of R B QB are real and ^ 0. (This is because the 

■•Sjg T? — ^ ^ ^ 

eigenvalues are the same as those of R B QBR / which is a matrix of 
T 

the form X X, which is known to have real eigenvalues ^0). From the 

-IT " 

Jordan canonical form (2) of R B QB we see immediately that ~ ^1’ 

2 

For each nonzero eigenvalue we have that s = -X/p, and the solutions of s 
h h 

are ±X /p . As p ^ O the branch of s in the LHP is a first order Butter- 

worth pattern with s.°° = X^. The not associated with first order 

^ 3 

•"X T ^ 

patterns lie in the kernel of R B QB, which is equal ho These Vj *s 

-1 T 

are not "trapped" by R B QB. 

CO CO 

The next step in the induction is to assume that and 
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axe valid. and^.then show that N. and S. are valid. The v.i. 's 

IX j 

corresponding to ith order patterns must lie in therefore 

N.” = U. ,W, for some W, . The case where there are no ith order patterns 
is trivial, because the is missing. Therefore asstime that there 
exists at least one ith order pattern. The next step is crucial. Fac- 
tor out of (3) the influence of the 's corresponding to lower order 
patterns. Do so by multiplying (3) on the left and right as shown be- 
low: 


+$'^(-s)$(s)]U^__^u) = 0. 


After some work this reduces to 




As p 0 the first term dominates and this can be written 


- (Vl ^VlHU, ,V.u. = 0 


i-1 i i-l' 


where X - (-l)^ps^^. 

The eigenvalues are real and ^ 0. From the Jordan canonical form (2) 

09 

we see that N. = U. -W_ . The solutions of s in the left half plane 
X x-1 1 ^ 

form an ith order Butterworth pattern with s.°° = X^. The v.”° not 

3 3 

s t 

corresponding to 1 through ith order patterns must lie in This 

completes the proof. 

The subspaces are shown in Figure 5.2. The following properties 
of the are simple consequences of the definitions and the above 
theorem. 

(i) 0 -U^cU^_^c...£U_^.e" 
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(ii) U. = ImN, + ... + Im N ” 

1 1+1 k 

(iii) if there are no ith order patterns. 

Use the following algorithm to find the matrices. In simple 
examples this can be done by hand. In more difficult examples use the 
software described below. 

1) Find a basis for = ker J^, call it U^. 

2) If dim = 0 then let k=l and stop. 

3) Let i=2. 

4) Find a basis for ker J^. 

5) Find a basis for U. -U. ker J. , call it U.. 

6) If dim = 0 then let k-i and stop. 

7) Go to 4. 

singular value decomposition (SVD) can be used to find an orthonormal basis 
for the ker J. . Since ker J. = ker G. and G. is symmetric, another way 
to find a basis for ker is to use the eigenvectors associated with 
the zero eigenvalues of G^. SVD can also be used to find an orthonormal 
basis for the intersection of two subspaces, see section 3 of 
La\ib's report [41] for more details. An orthonoinnal basis is not necessary 
for our purposes. FORTRAN subroutines exist in EISPACK [10] to compute 
the SVD -and the eigenvalue decomposition. 

The problem of finding Butterworth patterns of order greater than 
one is nimierically an ill-posed problem because an arbitrarily small 
change in A, B, or Q can cause a change in the order of the Butterworth 
patterns. By using proven software we have tried to minimize the 
numerical problems, but we cannot get rid of them. 

Example 2 Use the same A and B matrices as in example 1. Given 
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H and R the problem is to find X°, S , N , and y for .the optimal 
root locus . Let 


H = 

-65 

1 

rH 

0 

0 

R = 

1 

* 

0 

H 

1 

« 

0 

H 

1 


,100 

10 0 0. 


.-.01 

.I2IIJ 


Using a computer program that finds the transmission zeroes of S(A,B,H) 
by using a generalized eigenvalue problem we see that 

-.089“ 

.891. 

0 

-5.79 

. 

We now implement the algorithm described in this section for finding 
00 00 

S , N , and y. 





"0 

1 “ 


~1 

= HB = 



JT = 



.0 

0_ 

± 

_0_ 



-5 

10 


^2 = ^j^Hker = 0 


s t 

The mimber of 1 order patterns is dim U - dim U_ = 1, 

o 1 

nd 

The nvimber of 2 order patterns is dim ^2 “ 

The Jordan canonical forms are 


1 

(D 

0 

1 


1 

H 

L 


*0 
1 


1 

0 

H 

1 

Lo 3 . 


1 

H 

^0 


1 

0 

0 

L 


1 

H 

1 

H 

1 




Therefore 
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fl l"l 

Y = {01, 02, 12) 

5.3 Approximating the Optimal Root Locus 

In this section we are concerned with optimal root loci that have 
Butterworth patterns of order greater than one. What we will show is 
that any optimal root loci can be approximated by another that has only 
first order Butterworth patterns, and this approximation can be made 
arbitrarily precise for an arbitrary distance out along the asymptotes. 
This result is significant because it allows any optimal root locus 
problem to be treated as a generic problem, and the generic problem is 
numerically better conditioned than the nongeneric problem. 

The basic idea will first be presented in words. Then a more for- 
mal proof will be given using two lemmas and a theorem. Finally, an 
example will be given. 

Start with the well known fact that if Rank(HB) = m then the optimal 

root locus will have m first order Butterworth patterns. (If Q cannot 
- T 

be factored into H H then use M instead of H) . In the first lemma it 
is proved that if Rank(HB) < m then H can always be perturbed an arbi- 
trarily small amount such that the new H times B is full rank. ’In the 
second lemma an old result is quoted that essentially says that the 
eigenvalues of a matrix are continuous with respect to the elements of 
the matrix. Then in the theorem the Hamiltonian system matrix, for 

y 

some fixed value of p, is perturbed a small amount so that the eigen- 
values mpve less than a prespecified amount and the rank condition on 


OO 



^2 
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HB is changed. For p smaller than this the infinite modes of the 

optimal root locus will fall into first order patterns. 

Lemma 1 Let H be a real m x n matrix and B a real n x m matrix. 
If B is full rank then there exists a Ah such that for all a 5 ^ 0 
Rank(H+AH)B = m. 

Proof Let Ah = where Im(W) = Im(B) - Im(H*^} rt Im(B) . 

The next lemma is copied from Wilkinson [38] and is due to 
Ostrowski. The bound given is not computationally useful due to the 
term. 

Lemma 2 Let A and B be n x n matrices with elements that satisfy 
the relationships 


a.. <1 

I I 


Ibyl < 1 


Then if A.' is an eigenvalue of A + oB, there is an eigenvalue X of 
A such that 


1 x’ - X 1 < (n+ 2 ) (n^a) 

Now we consider two optimal root loci. Let X be an eigenvalue on 
the root locus generated by A, B, H, and R. For some p = specify 
a ball of radius e centered around each X. Let X'. be an eigenvalue 
generated by A, B, H + aAH/ and R. We have the following result. 

Theorem 3 For every p >0 and e > 0 there exists an a > 0 and 

AH such that 


(i) Rank(H + aAH)B = m 

and for every p in the interval p^ < p < <» 

(ii) jx* - X| < e. 

The proof for the case Rank(HB) = m is trivial because we can 
let AH = 0. When Rank(HB) < m choose a AH such that Rank(H + aAH)B = m 
for all a > 0, which is always possible from lemma 1. Next, use the 
fact that the optimal root loci corresponds to the LHP eigenvalues of 


A 


T 

-H H 


- br"^b^ 
p 


-A 


T 


Z = 
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Let p = p^. When H is changed to H + aAH then Z changes to 


Z + aAZ = Z + a 


h'^HAH + Ah'^H + aAH^AH 


0 

0 


T 

The aAH AH term can be dropped because for a sufficiently small the 
largest element of aAH"^AH will be less than the largest of H^AH +AhFh 
C hoose 8 such that the largest element of (1/3) Z is less than one 
in absolute magnitude. Without loss of generality assume also that 
the largest element of (1/ 3)AZ is less than one in absolute magnitude, 
which will be true for a sufficiently small. Apply lemma 2 to get 


X* - X| < 3(2n + 2) (4n^a) 


where 2n is used instead of n because Z is 2n x 2n. The B term is 
included because if X is an eigenvalue of Z then X/B is an eigenvalue 
of (1/B)Z. Now choose a such that 

|X’ - X| < B(2n + 2) (4n^a)^^^^ < e. 


this can always be done, even though a may be very small. The theorem 
has been proved for p = p^. 

For p > p^ recompute Z and call it z'. Let B' be its largest 
element and note that B' ^3* Then using the same a in (4) we see 
that the distance between the eigenvalues of Z* and Z' + aAZ is also 
less than e. This completes the proof. 

Example 3 Use the same A and B matrices as in examples 1 and 2, 
and let 


H = 


"O 

_1 


0 

0 


1 

0 


0 

0 


R = I. 
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The optimal root locus has no finite modes. The four infinite modes 

CO 

group into a fxrst and third order Butterworth pattern with N = X/ 

00 

S ^ If and Y ^ COlf 02 f 12, 22), Now' suppose H xs perturbed xn sucb 

a way that RankCH + aAH)B ?=; m. Let 

[ 0 Q 0 q“| ° 

, CH + aAH)B = 

P 0 0 ij Lo a 

The optimal root locus is plotted for a =■ 0, .01, and .001. The results 
are in Table 5.1 and Figure 5.3. We see that when a > 0 the third 
order pattern shifts into a first order pattern and two new trans- 
mission zeroes appear. For the case when a = .01 the two optimal root 
loci are within e = .1 until p is less than .001. For the case when 

- 5 . 

a = .001 the approximation is within e = -13 until p is less than 10 
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Table 5,3 

Approximations of an Optimal Root. Locus 


p Closed Loop Eigenvalues 


Case #1; 

a=0 





lO"^ 


-3.31 

-5.00 

-2.00± i 

1.01 

lo"^ 


-31.6 

-5.17 

-2.23 + i 

1.68 

io“^ 


-316 

-7.61 

-3.75 ± i 

5.25 

10-"" 


-lo" 

-464 

-232 ± i 

402 

Case #2: 

a=10 2 





H 

1 

o 

H 


-3.31 

-5.00 

-2.00 ± i 

1.01 

lO"^ 


-31.6 

-5.18 

-2.22 ± i 

1.69 

H 

O 


-316 

-7.74 

-3-66 ± i 

5.27 

10-"" 


-10® 

-lo" 

-2.00 ± i 

31.6 

Case #3; 

ct=10"2 





H 

o 

1 

H 


-3.31 

-5.00 

-2.00 ± i 

1.01 

10-2 


-31.6 

-5.27 

-2.19 ± i 

1.76 

lo”" 


-316 

-8.97 

-2.96 ± i 

5.33 

10-"" 


-10® 

-lo" 

-2.00 ± i 

10.0 
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CHAPTER VI 
Conclusion 

The linear state feedback problem was studied in this thesis, and 
as a special case- the linear quadratic regulator was studied. Of 
primary interest was the relationship between the state feedback gain 
matrix and the closed loop eigenstruct-ure of the linear state feed- 
back problem, and the relationship between the quadratic weights and 
the closed loop eigenstructure of the linear quadratic regulator. 

Several new results were derived which will help both the analysis- and 
the design of multivariable linear control systems. 

The relationships were discussed in terms of maps between parameter 
spaces. The names of the maps used here are not standard and not 
important, but this seems to be a natural way to discuss the relation- 
ships. The similarities between the linear state feedback problem and 
the linear quadratic regulator become clear when using these maps, and 
these similarities were exploited in this thesis. 

In Chap.ter III equations were derived to compute angles on the 
root locus and -the optimal root locus, including angles of departure 
and approach. For the first time the generalized -eigenvalue problem 
was used to compute the angles of approach. Then the quadratic weights 
were defined to be continuously dependent on p and equations were given 
for the direction and rate of change of the closed loop eigenvalues 
with respect- to p. These equations were used to analyze the inverse 
square method of selecting quadratic weights. All of the above results 
are valid only at the points where eigenvalues are distinct. Extending 

I 

these results to multiple eigenvalue points appears to be a nontrivial 
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problem. 

In Chapter IV two different kinds of equivalence classes of 

quadratic weighting matrices were defined. Most of the' attention was 
00 

given to the E equivalence class - those quadratic weighting matrices 
that produce the same asymptotic eigenstructure. Sufficient conditions 

Co 

were given for matrices to be in the E ^equivalence class, a canonical 
element was defined, and am algorithm given to find the canonical ele- 
ment. Then it was shown by example that the closed loop eigenstructure s 

can be different in the nonasymptotic region for members of the same 
00 

E equxvalence class. 

o • 

More research needs to be done concerning the E and E equivalence 
classes. Necessary conditions need to be derived for matrices to be in 

CO 

the same E equivalence class, and these conditions are probably not 

much more complicated than the sufficient conditions already derived. 

00 

It would also be beneficial to divide up the E equivalence class 
according to the equivalence relation that the closed loop eigenstruc- 
ture be the same in the nonasymptotic region. Having the same angles 
of departure and approach may be a way to do this, having the same D 
and E may be another. Similar questions apply to the E° equivalence 
class. We do not yet know if all members of the E° equivalence 
class Cthose quadratic weighting matrices that produce the same optimal 
gain matrix) have the same asymptotic properties. If not then the E° 
equivalence class can be further split up. ■ Within this (possibly) 
smaller set of quadratic weighting matrices a canonical element can be 

defined that has the following properties (and possibly others in order to 

T 

assure uniqueness) : the O is of rank m and S(A,B,H) (where Q = H H) 
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has transmission zeroes in the left half plane. To find this canonical 
element the asymptotic properties of the original (QfR) can be found, 
appropriate D, E, and Y matrices can be chosen, and then using equations 
(4. 1-4. 3) the canonical (Q,R) can be computed. 

Three related results were derived in Chapter V. The first was 
a synthesis solution for the linear state feedback problem, ftn 
algorithm was given that finds a feedback gain matrix ^ F that produces 

iC 

specified asymptotic properties as k -*• 0. Only the generic case was 
considered, so the obvious next thing to do is to extend this algorithm 
to handle nongeneric cases. Also, this technique may yield insight 
into selecting a feedback gain matrix K for the output feedback problem. 
In the generic case K can be chosen to arbitrarily select s”° and n” , 
but K has no effect on S°, X°,'or y 

The next result was ah algorithm to compute S*”, and y ' 
implicit in a set of quadratic weights. With this algorithm and previous 
results for and ,X° all of the implicit as^ptotic regulator pro- 
perties can now be found. With obvious similarity to the output feed- 
back problem, the asymptotic properties S°, X°, and y can be found from 
A, B, and Q; and s” and n“ can be found from A, B, Q, and R. The next 
thing to do is to modify this algorithm to find s”, N°°, arid a multi- 
index similar to y the output feedback problem. This will be 
more difficlut because the closed loop eigenvalues are no longer guaran- 
teed- to be symmetric about the imaginary axis. The elements of s'” are 
found by solving various eigenvalue problems , and because symmetry is 
not guaranteed the eigenvalue problems may have Jordan blocks of size 


2 X 2 or greater. 
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The final result shows that an optimal root locus with, Butterworth 
patterns of order greater than one can be approximated by an optimal root 
locus with all first order Butterworth patterns, and this approximation 
can be made arbitrarily precise for an arbitrary distance out along 
the asymptotes. This result may help to analyze optimal root loci. ‘ 
Determining the order of Butterworth patterns is numerically a badly 
conditioned problem, so by restricting our attention to a finite region 
of the complex s plane we can use the better conditioned problem of 
analyzing first order patterns. 
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APPENDIX A 
Transmission Zeroes 

Definition 

Several definitions of transmission zeroes exist in the literature 
and all have some validity. Common sense dictates that :the definition 
reduces to the usual one in the SISO case Cthe roots of the numerator 
polynomial of the transfer function) and that the transmission zeroes 
have some physical meaning. One definition that meets these require- 
ments is due to Rosenbrock [6] , which is the one used here. Though it 
is too early to know for sure, the control community appears to be 
settling down to this definition. 

Rosenbrock defines the system matrix 



and his definition of transmission zeroes is given in terms of the 
minors of PCs)- An equivalent definition uses the Smith McMillan form 
of P Cs) [42J . Since for our purposes we have the same niomber of inputs 
and outputs we use the following equivalent definition [7,43] ; The,.', 

transmission zeroes are those values of s, including multiplicities but 
not including uncontrollable or unobservable modes, that reduce the 
rank of PCs), We note that this definition allows the degenerate case 
where the whole .complex plane reduces the rank of PCs); this can happen 
even if B and C are full rank and the system is controllable and obser- 
vable, We note also in the square case that the determinant of PCs) is 
equal to 

detCA-sI)det[C(A-sI)“^B] , 


( 2 ) 
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cind another equivalent definition of transmission zeroes is the roots 
of (2) . This definition is used by Kwakernaak and Sivan [8] . 

To demonstrate that Rosenbrock's definition has physical meaning 
[42] we consider the linear output feedback system of section 2.2.2. 
Assume that it is controllable and observable and then Laplace transform 
(2.4, 2.5) to get 


A - si 

B 


X 


0 

-C 

0 


u 


-y 

ap 



_ . 


- . 


Transmission through the system is blocked (the output will be zero) 
for certain values of s, x, and u. Those values of s for which this is 
true are transmission zeroes, and the corresponding values of x are called 
zero directions. 

The Generalized Eigenvalue Problem 

The problem is to find all finite \ and their associated eigenvectors 
V which satisfy 


Lv = iMv, (3) 

where L and M are real p x p matrices not necessarily full rank. There 
will be from 0 to p finite solutions. If _M is invertible then premulti- 
plication by M ^ changes the generalized eigenvalue problem into an 
eigenvalue problem and there will be exactly p solutions. Stable and 
reliable F0RTR2iN subroutines exist in EISPACK [10] to solve the generalized 
•eigenvalue problem. 

Computing Transmission Zeroes 

Three different methods for computing transmission zeroes are dis- 
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cussed. The relationship between the first two methods is an unpublished 
result due to Laub. Only the special case of an equal number of inputs 
and outputs and no feedforward term is discussed. 

Latib and Moore [40] discuss in detail using the generalized eigen- 
value problem as a way to compute transmission zeroes. In place of (3)' 
use 


1 

> 

b" 


~x“ 

II 

"l 

1 

o 


X 

L-c 

o 


_v_ 


^0 

Oj 


_v_ 


The finite solutions X reduce the rank of Rosenbrock's system matrix (1) 
and therefore are transmission zeroes. There are anywhere from 0 to 
(n-m) transmission zeroes, and in the generic case when Rank(CB) — m 
there are exactly (n-m) solutions. The portion x of the associated eigen- 
vector is the zero direction. 

Davison and Wang [44] use high gain feedback and an eigenvalue 

problem to compute transmission zeroes. First they prove that as k ^ 0 

the finite closed loop eigenvalues of 

A , = A - ~ BKC (5) 

cl k 

approach the transmission zeroes. Their method is to find a "suitably 
small" value of k, compute the eigenvalues of A . , and then determine 

Cl 

which are finite. The eigenvectors associated with the finite eigen- 
values are the zero directions. 

These two methods are closely related. The connection is the result ' 
derived in section 3.2.1 that the closed loop eigenvalues and eigenvectors 
are solutions of the generalized. eigenvalue problem 
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(6) 


Equations {5) and (6) give the same answers for k > 0 and in the. limit as 
k 0. The only difference is that in (6) k can be set exactly to zero. 
Equation (6), incidentally, is an obvious way of proving that as k 0 
the closed loop eigenvalues approach the transmission zeroes. 

A third approach is found in various papers by MacFarlane, Karcanias, 

Kouvar itakas , and Shaked [for instance ’42,18]. They define N and M 

such that the rows of the (n-m) x n matrix N form a basis for the ker 
T 

(B ) and the columns of the rnx{n-m) matrix M form a basis for the ker(C) . 
Then the transmission zeroes are the roots of the polynomial . 

detCNAM - XNM) =0. (7) 

This result can be derived using similarity transformations on the 
matrices in (4 ) , see [42,18] for details. In the generic case when 
Rank(CB) = m then Rank(NM) - (n-m) and (7) is an eigenvalue problem, ie 
the (n-m) eigenvalues of (NM) ^NAM are the transmission zeroes. In the 
nongeneric case when Rank(CB) < m then it is not clear how to continue, 
other than to treat (7) as a generalized eigenvalue problem. 

The first method, by Laub and Moore, has the best numerical proper- 
ties and is the one to use. While all three methods give excellent 
results in some cases, Laub and Moore give examples where the other two 
methods break down. In Davison and Wang's method it is not obvious 
how to choose a suitably small k, and in some cases the accuracy of the 
answer is critically dependent on this choice. Furthermore, Davison and 
Wang's method gives no indication when the answers are in error; and 
therefore their method is unreliable. The method by MacFarlane et al. 
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unnecessarily requires rank determination, which numerically is a very 
difficult thing to do, and can introduce errors into the computations. 



